Method and apparatus for operating mobile terminal

ABSTRACT

There is provided a method of operating a mobile terminal, the method including: executing an application using both a pen input and a touch input; sensing a pen input through a first input unit, and performing a function corresponding to the sensed pen input; and sensing a touch input through a second input unit, and performing a function corresponding to the sensed touch input.

CROSS-REFERENCE TO RELATED APPLICATION(S) AND CLAIM OF PRIORITY

The present application is a continuation related to and claims thebenefit under 35 U.S.C. §120 to U.S. application Ser. No. 14/046,821filed on Oct. 4, 2013 and 35 U.S.C. §119(a) of a Korean patentapplication filed on Oct. 5, 2012 in the Korean Intellectual PropertyOffice and assigned Serial No. 10-2012-0110725, the entire disclosure ofwhich is hereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates generally to a mobile terminal. Morespecifically, the present disclosure relates to a method of operating amobile terminal using a pen or a body part such as a fingertip(s).

BACKGROUND

Mobile terminals have evolved to become multi-functional devices, suchas a smart phone, a Tablet, etc., and provide various useful functionsto users. Accordingly, the mobile terminals are becoming more common.Particularly, the smart phone or Tablet provides functions of playingmultimedia and games.

However, since most of latest electronic devices, such as a smart phoneor a Tablet, include no physical keyboard, there is inconvenience whenthey are used for a productive purpose such as word processing, comparedto other electronic devices including physical keyboards, such asNotebook.

In order to remove the inconvenience, a mobile terminal with a displayincluding a touch screen for receiving touch inputs and a digitizer forreceiving pen inputs has been developed so that a user can convenientlyperform word processing or painting on the mobile terminal by touchingthe touch screen using a body part (for example, a fingertip) or a pen(for example, an S pen).

Generally, when a user touches the touch screen of a mobile terminalusing a pen or fingertip for word processing or painting, variousvirtual input tools are provided for the user.

If the user performs word processing, virtual input tools, e.g., a pen,an eraser, a brush, and a highlighter can be provided in order for theuser to select one of the virtual input tools through a menu setting.For example, if the eraser is selected, a touch input or a pen inputfrom the user functions as an eraser, and if the highlighter isselected, a touch input or a pen input from the user functions as ahighlighter.

However, since latest mobile terminals have a minimum number of physicalkeys, in order to change a virtual input tool to another one, a usershould stop word processing or painting, call a menu through a touchinput or a pen input to change an input tool to a desired one, and thenresume word processing or painting.

In other words, in order for a user to perform word processing orpainting with various input tools, the user should repeatedly performinconvenient operation of calling a menu and selecting an input tool.

Accordingly, a technique for quickly and conveniently performing wordprocessing or painting through touch inputs and pen inputs by allowing auser to easily select an input tool or change detailed settings of theselected input tool is needed.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

To address the above-discussed deficiencies, it is a primary object toprovide a technique for quickly and conveniently performing operations,such as word processing or painting, using touch inputs and pen inputs.

In accordance with an aspect of the present disclosure, there isprovided a method of operating a mobile terminal, the method including:executing an application using both a pen input and a touch input;sensing a pen input through a first input unit, and performing afunction corresponding to the sensed pen input; and sensing a touchinput through a second input unit, and performing a functioncorresponding to the sensed touch input.

In accordance with another aspect of the present disclosure, there isprovided an apparatus of operating a mobile terminal, the apparatusincluding: a display unit including a first input unit for receiving apen input and a second input unit for receiving a touch input; and acontroller performing a function corresponding to a pen input sensedthrough the first input unit, and a function corresponding to a touchinput sensed through the second input unit, if an application using boththe pen input and the touch input is executed.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses certain embodiments of the disclosure.

Before undertaking the DETAILED DESCRIPTION below, it may beadvantageous to set forth definitions of certain words and phrases usedthroughout this patent document: the terms “include” and “comprise,” aswell as derivatives thereof, mean inclusion without limitation; the term“or,” is inclusive, meaning and/or; the phrases “associated with” and“associated therewith,” as well as derivatives thereof, may mean toinclude, be included within, interconnect with, contain, be containedwithin, connect to or with, couple to or with, be communicable with,cooperate with, interleave, juxtapose, be proximate to, be bound to orwith, have, have a property of, or the like; and the term “controller”means any device, system or part thereof that controls at least oneoperation, such a device may be implemented in hardware, firmware orsoftware, or some combination of at least two of the same. It should benoted that the functionality associated with any particular controllermay be centralized or distributed, whether locally or remotely.Definitions for certain words and phrases are provided throughout thispatent document, those of ordinary skill in the art should understandthat in many, if not most instances, such definitions apply to prior, aswell as future uses of such defined words and phrases.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the present disclosure and itsadvantages, reference is now made to the following description taken inconjunction with the accompanying drawings, in which like referencenumerals represent like parts:

FIG. 1 is a block diagram illustrating a mobile terminal according toembodiments of the present disclosure;

FIG. 2 is a flowchart illustrating a method of operating a mobileterminal, according to embodiments of the present disclosure;

FIG. 3A illustrates a method of operating a mobile terminal according toembodiments of the present disclosure;

FIG. 3B illustrates a method of operating a mobile terminal according toembodiments of the present disclosure;

FIG. 3C illustrates a method of operating a mobile terminal according toembodiments of the present disclosure;

FIG. 3D illustrates a method of using a mobile terminal according toembodiments of the present disclosure;

FIG. 4A illustrates a method of operating a mobile terminal according toembodiments of the present disclosure;

FIG. 4B illustrates a method of operating a mobile terminal according toembodiments of the present disclosure;

FIG. 4C illustrates a method of operating a mobile terminal according toembodiments of the present disclosure;

FIG. 4D illustrates a method of operating a mobile terminal according toembodiments of the present disclosure; and

FIG. 4E illustrates a method of operating the mobile terminal accordingto embodiments of the present disclosure.

Throughout the drawings, like reference numerals will be understood torefer to like parts, components, and structures.

DETAILED DESCRIPTION

FIGS. 1 through 4E, discussed below, and the various embodiments used todescribe the principles of the present disclosure in this patentdocument are by way of illustration only and should not be construed inany way to limit the scope of the disclosure. Those skilled in the artwill understand that the principles of the present disclosure may beimplemented in any suitably arranged electronic device.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of thedisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of certain embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the disclosure as defined by the appended claims andtheir equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

FIG. 1 is a block diagram illustrating a mobile terminal according toembodiments of the present disclosure.

In this disclosure, the mobile terminal is assumed as a portableelectronic device. The mobile terminal can be a feature phone or adevice (for example, a smart phone and a tablet PC) that can be run onBada™, Tizen™, Windows series (for example, Windows 8™), iOS™, Android™,etc. Also, the mobile terminal can be a notebook, a digital camera, or avideo phone. However, the mobile terminal according to the presentembodiment is not limited to the above-mentioned devices.

Referring to FIG. 1, the mobile terminal includes a controller 10, aradio transceiver 23, an audio processor 25, a key input unit 27, amemory unit 30, and a display unit 50 including a first input unit 52and a second input unit 54. The radio transceiver 23 includes a RadioFrequency (RF) unit and a modem. The RF unit includes an RF transmitterfor up-converting a frequency of a signal to be transmitted andamplifying the signal to be transmitted, and an RF receiver forlow-noise amplifying a received signal and down-converting a frequencyof the received signal. The modem includes a transmitter for encodingand modulating the signal to be transmitted, a receiver for demodulatingand decoding a signal received from the RF unit, etc. However, it willbe obvious to one of ordinary skill in the art that a short-rangecommunication module such as a Wi-Fi module can be used to support thefunctions of the radio transceiver 23 or substitute for the radiotransceiver 23.

Through the radio transceiver 23, a user shares contents (for example,paintings, handwritings, etc.) input through the first and second inputunits 52 and 54 with others.

The audio processor 25 constitutes a codec including a data codec and anaudio codec. The data codec processes packet data, etc., and the audiocodec processes audio signals, such as voice, multimedia files, etc. Theaudio processor 25 converts a digital audio signal received from themodem into an analog signal through the audio codec to then reproducethe analog signal, or converts an analog audio signal received from amicrophone into a digital audio signal through the audio codec totransmit the digital audio signal to the modem. The data codec and theaudio codec can be separately provided or included in the controller 10.

By using the audio processor 25, the controller 10 recognizes contents(for example, handwritings) input through the first and second inputunits 52 and 54, convert the recognized contents into text, and outputthe text as voice information for the user. Thereby, the user canaurally determine whether the contents input through the first andsecond input units 52 and 54 have been correctly input according tohis/her intention.

The key input unit 27 includes keys for allowing a user to inputnumerical and text information, functional keys for setting variousfunctions, a touch pad, etc. If the display unit 50 is implemented as atouch screen, the key input unit 27 includes a minimum number ofpredetermined keys, and the display unit 50 provides a part of the keyinput functions of the key input unit 27.

The key input unit 27 can be used independently or together with thefirst and second input units 52 and 54. Through the key input unit 27,the user provides a user input (for example, text) suitable for anexecution environment of the mobile terminal.

The memory unit 30 includes a program memory and a data memory. Theprogram memory stores programs for controlling the general operations ofthe mobile terminal. The memory unit 30 can further include CompactFlash (CF), Secure Digital (SD), Micro Secure Digital (Micro-SD), MiniSecure Digital (Mini-SD), Extreme Digital (xD), and an external memory,such as a memory stick and the like. Also, the memory unit 30 caninclude a disk, such as a Hard Disk Drive (HDD) and a Solid State Disk(SSD).

The display unit 50 can be a Liquid Crystal Display (LCD) or an OrganicLight Emitting Diodes (OLED) such as PMOLED or AMOLED, and displaysvarious data generated in the mobile terminal.

The display unit 50 includes a plurality of input units that arecomprised of a first input unit 52 for receiving pen inputs from theuser and a second input unit 54 for receiving capacitive touch inputsfrom the user. The display unit 50 can be a display used in Galaxy Noteof Samsung Electronics. Accordingly, the first and second input units 52and 54 can operate as input units for controlling the mobile terminaltogether with the key input unit 27.

The first input unit 52 is an input unit for receiving pen inputsthrough a pen (for example, an S pen of Samsung Electronics) operatingbased on electromagnetic induction, and includes a digitizer for sensinga location and pressure of the pen based on electromagnetic induction, acontroller, etc. The pen is dedicated to operate according to anoperation method (for example, electromagnetic induction) of the firstinput unit 52. Accordingly, a pen input from a user is sensed only bythe first input unit 52, not by the second input unit 54, which will bedescribed in more detail, later.

The second input unit 54 includes a capacitive-type touch screen panel,a controller, etc., and receives a touch input from a user according toa contact of a body part with the capacitive-type touch screen panel.The second input unit 54 is based on an operation method which isdifferent from that of the first input unit 52. Accordingly, a touchinput from a user is sensed only by the second input unit 54, not by thefirst input unit 52. However, it will be obvious to one of ordinaryskill in the art that the second input unit 54 can operate based onresistance, instead of capacitance.

As described above, since the first input unit 52 senses a pen inputbased on electromagnetic induction, and the second input unit 54 sensesa touch input based on capacitance, no pen input will be sensed by thesecond input unit 54 and no touch input will be sensed by the firstinput unit 52.

For example, if the user touches the surface of the display unit 50 withhis/her fingertip, the second input unit 54 senses a touch input, butthe first input unit 52 senses no input. Meanwhile, if the user touchesthe surface of the display unit 50 with a pen, the first input unit 52senses a pen input, but the second input unit 54 senses no input.

The controller 10 controls the entire operation of the mobile terminal,and can switch or control operations of the mobile terminal according toa user input received through the key input unit 27, the display unit50, etc. Particularly, the controller 10 controls operations of:executing an application using both a pen input and a touch input;sensing a pen input through the first input unit 52, and performing afunction corresponding to the sensed pen input; and sensing a touchinput through the second input unit 54, and performing a functioncorresponding to the sensed touch input. The operations of thecontroller 10 will be described in more detail, later.

Meanwhile, in FIG. 1, devices, such as a Bluetooth module, a cameramodule, a Wi-Fi module, an accelerometer, a proximity sensor, ageomagnetic sensor, a Digital Media Broadcasting (DMB) receiver, etc.,which can be included in the mobile terminal, are not illustrated.However, it will be obvious to one of ordinary skill in the art that theabove-mentioned devices can be included in the mobile terminal toprovide the corresponding functions.

FIG. 2 is a flowchart illustrating a method of operating a mobileterminal, according to embodiments of the present disclosure. Also,FIGS. 3A to 3D certain methods of operating the mobile terminalaccording to embodiments of the present disclosure. Also, FIGS. 4A to 4Ecertain methods of operating the mobile terminal according toembodiments of the present disclosure. Hereinafter, the method ofoperating the mobile terminal using a pen, a fingertip, etc. will bedescribed with reference to FIGS. 1, 3A to 3D and 4A to 4E.

In operations S201 to S203, the controller 10 executes an applicationaccording to a request from a user, displays functions corresponding toa touch input and a pen input, and then sets functions selected by auser to functions corresponding to the touch input and the pen input,respectively

In a conventional technique, since a pen input and a touch input areconsidered as the same user input, a pen input and a touch input areallocated the same functions.

For example, when an application, such as a memo or painting, isexecuted, a function selected from among a pen, an eraser, a brush, anda highlighter is performed according to a user input regardless ofwhether the user input is a pen input or a touch input. That is, if theeraser is selected, both a pen input and a touch input perform the samefunction of the eraser.

As another example, if a user wants to perform a highlighter functionwhen performing a pen function through a pen input (or a touch input),the user should set a function corresponding to a pen input (or a touchinput) to the highlighter function from the pen function, which cancause inconvenience.

In the embodiment of FIG. 3A, functions corresponding to a pen input aredenoted by 300 a, 300 b, 300 c, and 300 d, and functions correspondingto a touch input are denoted by 310 a, 310 b, 310 c, and 310 d.

A pen function denoted by 300 a enables a pen input to function as if itis an actual pen, an erase function denoted by 300 b enables a pen inputto function as if it is an actual eraser, a brush function denoted by300 c enables a pen input to function as if it is an actual brush, and ahighlighter function denoted by 300 d enables a pen input to function asif it is an actual highlighter. Likewise, each of pen, eraser, brush,and highlighter functions denoted by 310 a, 310 b, 310 c, and 310 d,respectively, enables a touch input from a body part (for example, afingertip) to function as if it is an actual pen, an actual eraser, anactual brush, or an actual highlighter.

As illustrated in FIG. 3A, if functions corresponding to a pen input anda touch input, respectively, are displayed, a user can select a functioncorresponding to a pen input and a function corresponding to a touchinput. For example, as illustrated in FIG. 3B, a user can select the penfunction 300 a as a function corresponding to a pen input, and the erasefunction 300 b as a function corresponding to a touch input.

In FIG. 3A, a case of independently setting functions corresponding to apen input and a touch input is illustrated. However, according toanother embodiment, it is possible to set a function corresponding to aninput type (for example, a pen input), and then set a functioncorresponding to the other input type (for example, a touch input) as asub function of the function set to correspond to the input type.

For example, if a request for setting functions corresponding to a peninput and a touch input is received from a user (or automatically whenan application is executed), the controller 10 controls the display unit50 to display a setting screen as illustrated in FIG. 4A or 4B.

Referring to FIG. 4A, an example in which a user has selected a “pen”400 a as a function corresponding to a pen input, and then selected asub function (for example, the color of the pen, the thickness of thepen, the kind of the pen, etc.) of the “pen” function, as a functioncorresponding to a touch input is illustrated. Likewise, referring toFIG. 4B, an example in which a user has selected a “brush” 400 c as afunction corresponding to a pen input, and then selected a sub function(for example, the color of the brush, the thickness of the brush, thekind of the brush, etc.) of the “brush” function, as a functioncorresponding to a touch input is illustrated.

As illustrated in FIG. 3A or 4A, a setting screen for setting(selecting) functions corresponding to a pen input and a touch input,respectively, is displayed in such a manner to allow a user to setmenus, icons, etc. Also, the application executed in operation S201 isan application that enables a user to simultaneously use a pen input anda touch input, and can be a memo application, a painting application,etc.

In operations S204 to S207, if the controller 10 determines that a peninput has been received through the first input unit 52, the controller10 performs a function corresponding to the pen input, and if thecontroller 10 determines that a touch input has been received throughthe second input unit 54, the controller 10 performs a functioncorresponding to the touch input.

As described above in operations S201 to S203, if functionscorresponding to a pen input, sensible only by the first input unit 52,and a touch input, sensible only by the second input unit 54,respectively, are set, the user can use the application with thefunctions corresponding to the pen input and the touch input accordingto the corresponding settings.

As illustrated in FIG. 3B, if a “pen” function is set as a functioncorresponding to a pen input and an “eraser” function is set as afunction corresponding to a touch input, the user can use the setfunctions as illustrated in FIGS. 3C and 3D.

Referring to FIGS. 3C and 3D, when the user handwrites “GALAXY” using apen and then wants to erase “AXY”, the user can perform a touch input(see 350 a and 350 b) erasing “AXY” with his/her fingertip instead ofthe pen, thereby easily erasing “AXY”.

According to the example as illustrated in FIGS. 3C and 3D, since a peninput is set to have a pen function and a touch input is set to have anerase function, a user can handwrite letters and easily erase a desiredpart of the handwritten letters as necessary, without a separate menusetting (for example, changing a pen function to an erase function).

The examples described above with reference to FIGS. 3A to 3D relate toa case in which functions set for a pen input sensible by the firstinput unit 52 are different from functions set for a touch inputsensible by the second input unit 54.

Meanwhile, the following examples, which will be described withreference to FIGS. 4A to 4D, relate to a case in which functions set fora touch input sensible by the second input unit 54 are sub functions offunctions set for a pen input sensible by the first input unit 52.

FIGS. 4C to 4E correspond to a case in which a pen function 400 a is setas a function corresponding to a pen input, and a sub function of thepen function 400 a is set as a function corresponding to a touch input.

As illustrated in FIG. 4C, there is a case in which when a user hashandwritten letters “GALA” with a pen on a display screen 430, the userwants to adjust the size of letters to be handwritten.

In order to adjust the size of letters to be handwritten, as illustratedin FIG. 4D, the user can touch the display screen 430 with a fingertipinstead of a pen. For example, if the user touches the display screen430 with his/her fingertip, a setting graph 470 for adjusting the sizeof letters to be handwritten is displayed so that the user can select adesired size from the setting graph 470 through a touch input (forexample, a drag operation in an up-down direction) such as a touchoperation denoted by 460 a, 460 b, or 460 c.

For example, if the user touches the bottom part of the setting graph470, the size of letters will be adjusted to 6 pixels (6 px) (or to 6points (6 px) or 6 ems (6 em) in a unit of point or ems), and if theuser touches the top part of the setting graph 470, the size of letterswill be adjusted to 72 pixels (72 px).

If the size of letters to be handwritten through a pen input is adjustedas described above with reference to FIG. 4D, the user can input nextletters XY with the adjusted size on the display screen 480 through apen input 440, as illustrated in FIG. 4E.

According to the examples described above with reference to FIGS. 4A to4D, since when handwriting letters through a pen input, a user caneasily adjust the size of letters through a touch input using afingertip without having to newly set an icon or menu, the user caneasily handwrite letters using a pen input.

In operation S208, after the controller 10 performs the functioncorresponding to the pen input or the touch input received through thefirst input unit 52 and the second input unit 54, the controller 10determines whether the application executed in operation S201 hasterminated.

Meanwhile, in the present embodiment described above with reference toFIG. 2, operations S202 to S203 are performed prior to operations S204to S207, however, operations S202 to S203 can be performed between otheroperations according to the user's request or the application's setting.

Therefore, according to the embodiments of the present disclosure asdescribed above, a user can conveniently use a mobile terminal through apen input and a touch input without having to perform inconvenientoperations such as icon or menu settings.

Although the present disclosure has been described with certainembodiments, various changes and modifications may be suggested to oneskilled in the art. It is intended that the present disclosure encompasssuch changes and modifications as fall within the scope of the appendedclaims.

What is claimed is:
 1. A method implemented by an electronic apparatus,the method comprising: executing an application; in response to a firstpen input associated with the application on a display of the electronicapparatus, displaying a first handwriting stroke with a first attribute;in response to a touch input on the display, displaying at least onegraphic element representing a plurality of attributes; detectingselection of a second attribute from among the plurality of attributes;and in response to a second pen input associated with the application onthe display, displaying a second handwriting stroke with the secondattribute.
 2. The method of claim 1, wherein the first attributeincludes a first color or a first thickness, and the second attributeincludes a second color or a second thickness.
 3. The method of claim 2,wherein the plurality of attribute include a plurality of colors or aplurality of thicknesses.
 4. The method of claim 1, wherein theapplication is a memo application or a painting application.
 5. Themethod of claim 1, wherein the display includes a capacitive touchscreen panel.
 6. The method of claim 5, wherein the touch input isdetected by the capacitive touch screen panel.
 7. The method of claim 1,wherein the touch input is a capacitive touch input.
 8. A non-transitorystorage medium storing instructions configured to cause, when executedby at least one processor, the processor to perform at least oneoperation, the at least one operation comprising: executing anapplication; in response to a first pen input associated with theapplication on a display of an electronic apparatus, displaying a firsthandwriting stroke with a first attribute; in response to a touch inputon the display, displaying at least one graphic element representing aplurality of attributes; detecting selection of a second attribute fromamong the plurality of attributes; and in response to a second pen inputassociated with the application on the display, displaying a secondhandwriting stroke with the second attribute.
 9. The non-transitorystorage medium of claim 8, wherein the first attribute includes a firstcolor or a first thickness, and the second attribute includes a secondcolor or a second thickness.
 10. The non-transitory storage medium ofclaim 9, wherein the plurality of attribute include a plurality ofcolors or a plurality of thicknesses.
 11. The non-transitory storagemedium of claim 8, wherein the application is a memo application or apainting application.
 12. The non-transitory storage medium of claim 8,wherein the display includes a capacitive touch screen panel, and thetouch input is detected by the capacitive touch screen panel.
 13. Thenon-transitory storage medium of claim 8, wherein the touch input is acapacitive touch input.
 14. An electronic apparatus comprising: adisplay; and a controller configured to: execute an application; inresponse to a first pen input associated with the application on thedisplay, display a first handwriting stroke with a first attribute; inresponse to a touch input on the display, display at least one graphicelement representing a plurality of attributes; detect selection of asecond attribute from among the plurality of attributes; and in responseto a second pen input associated with the application on the display,display a second handwriting stroke with the second attribute.
 15. Theelectronic apparatus of claim 14, wherein the first attribute includes afirst color or a first thickness, and the second attribute includes asecond color or a second thickness.
 16. The electronic apparatus ofclaim 15, wherein the plurality of attribute include a plurality ofcolors or a plurality of thicknesses.
 17. The electronic apparatus ofclaim 14, wherein the application is a memo application or a paintingapplication.
 18. The electronic apparatus of claim 14, wherein thedisplay includes a capacitive touch screen panel.
 19. The electronicapparatus of claim 18, wherein the touch input is detected by thecapacitive touch screen panel.
 20. The electronic apparatus of claim 14,wherein the touch input is a capacitive touch input.